Skip to content

Conversation

@minfhong-qti
Copy link
Contributor

Description

  • Input pb files were read in incorrect order.
    • Cause: Python sorted was used to acquire sorted input files in order. However, the input files would be in incorrect order since "10" is lexicographically smaller than "2".
    • Fix: Revise to enumerating indices to read input files.
  • CumSum's output wasn't quantized.
    • Cause: CumSum wasn't registered into QDQ registry.
    • Fix: Register CumSum with QDQDirect8bitOp.

Motivation and Context

Fix two issues in static_quantize_runner usage.

- Bug: Read input pb files in incorrect order.
  - Cause: Python `sorted` was used to acquire sorted input files in
      order. However, the input files would be in incorrect order
      since "10" is lexicographically smaller than "2".
  - Fix: Revise to enumerating indices to read input files.
- Bug: CumSum's output wasn't quantized.
  - Cause: CumSum wasn't registered into QDQ registry.
  - Fix: Register CumSum with QDQDirect8bitOp.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant